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Abstract  -  Venous  thrombosis  is  a  common  pathology 
that  creates  serious  problems  in  public  health.  The 
diagnostic  of  thrombosis,  particularly  the 
determination  of  their  relative  ages  can  be  efficiently 
accomplished  by  ultrasound  imaging.  This  study 
intends  to  classify  automatically  the  thrombosis  ages  by 
using  a  predefined  learning  base  that  depends  on  a 
prior  knowledge  of  physicians.  In  practice,  this 
learning  base  is  affected  by  information  imperfections 
of  the  type  ambiguity  since  physicians  cannot  give  exact 
thrombosis  ages.  Thus,  the  proposed  learning  base  is 
constructed  in  a  3-tuple:  observation,  label, 
membership  value  in  term  of  fuzzy  logic  for  each  class 
and  not  a  2-tuple  as  in  the  usual  supervised  Bayes 
classification  application.  By  considering  this  “fuzzy 
learning  base”,  a  method  modeling  simultaneously  the 
concept  of  probabilistic  uncertainty  and  ambiguity  is 
proposed.  In  this  approach,  the  probability  for  a  given 
observation  is  considered  on  the  membership  value  of 
each  class  and  not  on  the  class  itself.  At  this  level,  the 
discussion  focuses  on  two  types  of  applications:  the 
thrombosis  ages  classification  and  the  definition  of 
membership  function  by  using  a  fuzzy  learning  base  for 
classification. 

Keywords  -  Venous  thrombosis,  echography,  ultrasound 
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I.  Introduction 

The  characterisation  of  blood  clots  and  especially  the 
explanation  or  knowledge  of  their  maturing  process,  are 
difficult  to  be  comprehended  due  to  the  lack  of  efficient 
analysing  methods  or  diagnostic  procedures.  Echography,  an 
indirect  but  simple  imaging  system,  presents  an  interesting 
potential  in  terms  of  resolution,  discrimination  capabilities 
and  3D  possibilities  to  analyse  these  pathologies. 

The  common  encountered  problems  in  medical  imaging 
include  segmentation,  reconstruction,  classification  and 
diagnostic  aid  systems.  Until  now,  there  are  not  much  works 
being  done  in  the  domain  of  supervised  classification  of 
pathologies  by  ultrasound  imaging.  This  is  due  to  certain 
circumstances  and  existing  difficulties  in  medical  as  well  as 
in  image  processing  domain  that  complicate  this  problem. 
The  learning  base  that  we  obtain  is  not  perfect  since  the 
interpretation  of  pathologies  by  echographic  images  is  not 
easy,  as  it  requires  some  expertise  experience.  Furthermore, 
the  diagnostics  of  pathologies  given  by  physicians  are  usually 
qualitative.  Different  physicians  while  examining  patients 


with  the  same  pathologies  may  give  different  judgements.  On 
the  other  hand,  the  extraction  of  features  that  can  interpret 
correctly  the  medical  criteria  such  as  echogenecity  and 
echostructure  are  perturbed  by  the  presence  of  speckle  noise 
in  echographic  images.  It  is  necessary  to  quantify  the 
pertinence  of  features  and  verify  that  they  are  sufficiently 
discriminating  for  the  classification  purposes. 

In  this  work,  a  method  that  is  able  to  improve  the 
performance  of  a  classification  system  is  discussed.  After 
a  brief  description  of  the  medical  problematic  of  this  study 
in  section  II,  the  methology  is  presented  in  section  III. 
Conclusions  and  future  works  end  the  discussion  of  this 
paper. 

II.  Medical  problematic 

At  the  present  day,  some  recent  studies  go  toward  the 
development  of  3D  free  hand  and  ultrasound  system  [1].  This 
study  intends  to  introduce  a  method  for  thrombosis  age 
classification  through  the  use  of  this  kind  of  acquisition 
system.  In  order  to  achieve  this  purpose,  we  aim  to  implement 
a  3D  acquisition  system  so  that  well-aligned  images  can  be 
acquired  and  3D  analysing  of  data  can  be  achieved.  Until 
now,  the  developed  system  is  a  prototype  that  allows  in  vitro 
thrombosis  or  blood  clots  acquisition.  However,  this  system 
will  be  improved  in  a  near  future  so  that  graded  in  vivo 
images  can  be  acquired  during  patient  examinations.  This 
prototype  is  based  on  an  existing  echography  and  completed 
by  an  electro-magnetic  3D  localizer  that  devotes  the  3D 
capabilities  to  the  system.  The  acquisition  system  that  we  use 
is  a  product  of  Advanced  Technology  Laboratories  (model 
HDI  5000). 


Fig.  1.  A  complete  system  for  in  vitro  thrombosis  or  blood  clot  image 
acquisition.  The  3D  aligned  echographic  images  are  acquired  by  the 
movement  of  an  echography  catheter,  where  the  acquisition  position  is 
transmitted  by  the  sound. 
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The  study  of  maturing  process  is  a  fundamental  issue  for  the 
medical  research  and  particularly  for  the  understanding  of 
blood  clots  formation  mechanisms.  The  interest  from  the 
perspective  of  diagnostic  aid  is  clear.  In  fact,  this  will  create 
the  possibility  of  categorizing  the  pathologies  and  associating 
them  with  the  corresponding  therapies.  Through  this  model, 
the  effects  of  maturing  process  will  become  more 
comprehensible.  Our  interest  is  the  classification  of 
thrombosis  age  based  on  a  series  of  in  vitro  thromboses 
images  (Fig.  2). 
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Fig.  2.  In  vivo  thrombosis  (left)  and  in  vitro  thrombosis  or  blood  clot  (right) 
images  acquired  by  echography 

These  in  vitro  thromboses  are  in  fact  the  formation  of  blood 
clot  from  blood  sample  that  contributed  by  some  volunteers. 
The  acquisition  of  these  blood  clot  images  is  done  each  day 
for  duration  of  5  days.  Our  purpose  is  to  construct  an  example 
base  with  the  collaboration  of  physicians  since  their 
knowledge  and  experience  are  necessary  in  attributing  an  age 
for  each  example.  In  a  near  future,  the  study  of  in  vivo 
thromboses  images  of  actual  examinations  will  then  follow 
(Fig.  2).  For  the  in  vivo  case,  a  great  number  of  patient 
examinations  are  required  to  confirm  the  efficiency  of  our 
studies.  However,  some  immediate  difficulties  arise  in 
controlling  the  example  of  learning  base.  It  is  affected  by 
some  imperfections  due  to  the  observation  ambiguity  and 
decision  ambiguity  that  caused  by  the  qualitative  judgement 
of  physians.  Thus,  our  goal  is  to  develop  a  classifier  method 
that  can  take  into  account  the  ambiguity  or  the  quality  aspect 
of  the  diagnostic  state  attributed  to  the  examples  of  learning 
base. 


III.  Methodology 

In  the  classification  problem,  more  generally  in  the 
pattern  recognition  problem,  information  imperfection  can 
appear  in  all  level:  from  the  observed  scene  to  the  decision 
space  (Fig.  3).  These  imperfections  may  be  caused  by  the 
sensor,  the  feature  extraction  process  and  the  decision  system 
itself.  All  these  imperfection  sources  can  be  modeled  by  the 
consideration  of  an  information  element  (IE)  as  in  [2].  The 
manner  to  define  an  IE  allows  us  to  model  different  kinds  of 
information  imperfections  such  as  inaccuracy,  ambiguity, 
uncertainty  and  evidential. 


Object  space  Observation  space  Feature  space  Decision  space 


Fig.  3.  A  general  scheme  of  pattern  recognition  system 

This  work  focuses  on  the  supervised  classification  in 
considering  the  feature  space  and  the  decision  space.  In  actual 
situation,  there  may  have  ambiguity  in  observation,  features 
and  decision  space  that  affect  the  learning  base.  If  the 
observations  are  ambiguous,  then  the  consideration  of  fuzzy 
propositions  Pt  (“A  is  B”  where  B  is  a  given  concept)  is 
needed,  whereas  if  the  imperfection  concerns  the  classes  Ch 
then  we  have  to  consider  fuzzy  set  in  the  decision  space  (Fig. 

4). 


Fig.  4.  Learning  base  possible  imperfection 
A.  Fuzzy  concepts  to  model  physician  diagnostic  ambiguity 

In  this  study,  the  decision  space  is  affected  by  ambiguity 
since  the  physician  cannot  provide  an  exact  thrombosis  age. 
Due  to  this  reason,  we  propose  the  physician  to  assign  a 
“degree  of  truth”  for  each  proposition  of  thrombosis  age.  By 
this  way,  a  membership  value  is  assigned  to  each  class  Ch 
i=l,...,K  for  a  given  thrombosis  case,  where  every  class  is  a 
finite  time  interval.  Thus,  the  notion  of  membership  function 
(initially  introduced  by  Zadeh  [3]),  relative  to  a  class  Q  for  a 
given  thrombosis  case  /Ua  is  defined  as  follows: 

Me,  '■  X  — >  [°,l] 

jia  :  X—x — >jUci(X=x)  ^  j  ^ 

where  X  is  the  feature  space.  These  class  of  membership 
function  denotes  the  relation  between  the  observed  feature  x 
to  the  concept  of  class  Q. 

The  physician  reasoning  is  qualitative  and  based  on  their 
own  experience.  They  are  also  against  the  idea  to  quantify  the 
“degree  of  truth”  on  a  diagnostic.  As  in  [3],  we  propose  to 
establish  a  scale  of  relation  between  the  linguistic  variables 
and  the  numerical  world.  The  relation  must  be  done  with  a 
particular  attention  since  we  have  to  consider  all  possible 
situations  posed  by  the  application.  For  example,  we  suppose 
that  there  are  K  classes  G,  i=l,...,K  and  the  values  of 
membership  functions  are  interpreted  as 
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At  the  same  time,  we  cannot  conceive  to  ask  the  physician  to 
attribute  for  each  new  case  some  membership  value  of  their 
degree  of  truth  to  each  possible  class.  Thus,  we  propose  the 
physicians  to  give  their  opinion  on  a  thrombosis  age  and 
provide  a  degree  of  truth  via  linguistic  variables  as 
{“definitely  not”,  “not  very  sure”,  “not  sure”,  “sure”,  “very 
sure”,  “definitely  sure”}.  This  idea  may  be  processed  as  in 
Fig.  5,  where  the  distribution  of  membership  value  to  each 
class  Ck  is  a  gaussian  that  centered  on  the  class  Ck  itself,  with 
a  standard  deviation  that  is  proportional  to  the  degree  of  truth 
by  the  proposition  of  the  physicians.  By  this  way,  the 
physicians  can  define  easily  for  each  thrombosis  case  a 
degree  of  truth. 
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Fig.  5.  Example  of  membership  distributions  due  to  the  physician’s 
diagnostic  for  a  thrombosis  case  that  being  classified  in  the  class  of 
thrombosis  age  Ck,  with  the  degrees  of  truth  as  “not  very  sure”,  “sure”,  “very 
sure”  respectively. 


B.  Learning  base 

The  learning  base  is  constructed  according  to  the 
physicians’  reasoning.  The  decision  making  of  a  new 
thrombosis  case  is  based  on  the  expertise  knowledge  and  the 
patient  medical  history.  By  using  the  echography,  each 
diagnostic  is  compounded  by  an  age  estimation  added  with  an 
intuitive  “degree  of  truth”  on  this  decision.  Suppose  that  all 
possible  classes  of  thrombosis  ages  are  grouped  in  the  set 
£2  =  {Cl,...,CK},  the  “fuzzy  learning  base”  is  then  defined 
as  follows: 

B-{(.Y.C//,  )  (2) 

where  X  is  a  feature  vector  and  pa  is  the  membership 
function  to  each  class  Q.  With  this  fuzzy  learning  base,  the 
probability  is  considered  on  the  membership  function  for  each 
class  Ci  in  order  to  make  a  decision  based  on  both  the 
concepts  of  probabilistic  and  fuzzy  logic. 

C.  Classification  approach 

The  Bayesian  classification  is  based  on  the  “closed  world 
assumption”.  That  means  we  have  the  entire  knowledge  on 
the  component  of  the  decision  space  and  no  other  component 
is  possible.  In  the  context  that  all  possible  classes  of 
thrombosis  ages  are  grouped  in  the  set  Q  =  {Cl , . . . ,  CK  },  we 


assume  that  it  is  possible  to  consider  information 
exclusivity  and  exhaustivity.  That  means  we  have: 

^ P(C. ) - 1  and  Vz* j,  C.nC.  =0.  (3) 

From  now  onwards,  we  consider  the  problem  from  the 
Bayesian  point  of  view.  Given  a  stochastic  vector  of 
features  labeled  X=x,  we  can  express  the  following 
conditional  probability: 


P(X=.xjC=G)=- 


P(C=CX=x)P(X=x) 


P(C=G) 

The  decision-making  is  based  on 

p(X=x\C=C)P(C=C) 


P(C=G\X=x)  = 


P(X=x) 


(4) 


(5) 


where  P(X=x)  is  the  feature  probability,  P(CKJ)  is  the  a  prior 
probability  of  a  class  and  P(X=^C=Ci)  is  the  probability  of 

the  observation  of  feature  A  belonging  to  the  class  Ch 

This  theoretical  concept  requires  that  all  hypotheses  are 
perfectly  satisfied.  In  particular,  the  considered  features  have 
to  be  discriminant  enough  and  all  possible  classes  have  to  be 
perfectly  and  precisely  known.  At  the  same  time,  the  learning 
base  imprecision  limits  such  an  approach.  Thus,  all  classes 
associated  with  the  observations  are  perfectly  known  but  not 
having  the  sufficient  accuracy.  Here,  we  do  not  associate  a 
feature  vector  with  a  class  but  a  feature  vector  with  a  fuzzy 
set  to  the  class  Q.  Works  have  already  been  done  by  posing 
some  bases  on  how  to  relate  fuzzy  set  and  probability  theories 
[4].  In  our  application,  we  establish  the  bridge  by  modifying 
the  conditional  probability  defined  in  (4)  to  obtain  a  new 
definition  as  follows: 

,  P(Ua  =  v\X  =  x)P(X  =  X )  rrx 

P(X  =  x\pci  =  V)  =  — - ! - — - -  •  (6) 

1  P<JI«  =  V) 

This  leads  to  a  new  Bayes  expression  by  taking  into 
account  the  learning  base  imprecision: 

,  P(X  =  x\  Lid  =  v)P{Ud  =  v) 

P(jUc,  =  v\x  =  x)  =  — - - -  (7) 

1  P(X  =  x) 


In  the  last  relation,  T(X=x)  is  the  feature  probability,  p(pci  =  v) 
is  the  probability  of  a  given  membership  value  relative  to 
class  P(X  =  x\ga  =v)  is  the  probability  of  the 

observation  of  feature  X  considering  a  degree  of  truth  that 
belong  to  the  class  Ct.  The  expression  (7)  seems  very  similar 
to  (5),  but  its  interpretation  is  totally  different.  In  this  case,  we 
do  not  evaluate  the  power  of  the  link  between  a  thrombosis 
case  and  a  class,  but  the  link  between  this  thrombosis  case 
with  a  fuzzy  set  associated  with  the  membership  function  jLlci. 


Fig.  6.  For  each  class  Q,  the  probability  to  observe  a  membership  value  to 
the  class  Q,  given  the  feature  X,  can  be  represented  as  a  surface.  In  this  case, 
a  two  dimensions  space  is  considered  while  in  the  classical  Bayes  rule,  only  a 
mono -dimension  space  is  considered. 

The  understanding  cannot  be  perfect  without  being  sensible  to 
the  following  considerations  and  in  particular  of  the 
consistence  of  jua. 

•  The  cases  with  different  features  but  have  the  same 
membership  values:  Two  patients  with  different  thrombosis 
maturing  state  might  have  been  assigned  the  same  degree  of 
truth  to  certain  class  by  the  physician,  that  is, 

Xi^Xj  but  /Lkk(x)=lLkk{Xj).  (8) 

•  The  cases  with  the  same  feature  but  have  different 
membership  values:  Two  patients  with  the  same  thrombosis 
maturing  state  might  have  been  assigned  different  degree  of 
truth  to  certain  class  by  the  physician,  that  is, 

Xi=Xj  but  fjck(]G}*iJck(xj)'  (9) 

These  two  remarks  show  how  difficult  it  is  to  establish  a 
perfect  relation  between  the  classes  and  the  observation,  by 
using  only  fuzzy  logic.  That  is  why  the  probabilistic  point  of 
view  is  very  useful.  Now,  we  can  develop  the  following 
criteria  in  some  simple  particular  cases  in  order  to  establish  a 
possible  approach  for  the  decision-making  process: 

1)  If  the  value  of  membership  function  (la  =v  is  high  and 
the  probability  p(ju«  =  v  |  X  =  x)  is  high,  then  the  probability 
of  the  observation  in  class  Q  is  high. 

2)  If  the  value  of  membership  function  fia  =v  is  low  and  the 
probability  P{pa=v  |  X=x)  is  low,  then  the  probability  of  the 
observation  in  class  Q  is  high. 

3)  If  the  value  of  membership  function  jUa=v  is  low  and 
the  probability  P(jua=v  |  X=x)  is  high,  then  the  probability  of 
the  observation  in  class  Q  is  low. 

4)  If  the  value  of  membership  function  jUa  =v  is  high  and 
the  probability  P(jua=v  |  X=x )  is  low,  then  the  probability  of 
the  observation  in  class  Q  is  low. 

It  is  important  to  understand  that  on  real  data,  the  problem  of 
decision-making  is  harder  and  need  to  be  studied  more 
precisely  when  ambiguous  cases  are  encountered.  For 
example,  it  is  difficult  to  make  decision  when  the 
membership  value  fM  =v  ~  0.5  and  the  probability 

P(jUa  —V  \X=x)~  0.5.  Also,  the  problem  of  ambiguity  may 


arise  in  decision-making  when  the  membership  values  and  the 
probabilities  for  two  different  classes  Cz  and  Cj  are  very  close, 
that  is,  jia  =Vi ~Vj  —ficj  and  P(ju=v  |  X=x^F(jU:j=v  |  X=r)- 

IV.  Conclusion 

This  preliminary  study  proposes  to  develop  an  acquisition 
system  and  some  methods  to  classify  pathologies  from 
ultrasound  image  sequences  through  the  consideration  of  2D 
and  3D  features.  More  particularly,  we  deal  with  a  particular 
type  of  imperfection  of  the  kind  of  ambiguity,  which  can  alter 
the  quality  of  learning  bases  when  we  focus  on  supervised 
classification  methods.  The  considered  application  i.e.  the 
thrombosis  age  evaluation,  enter  exactly  in  this  kind  of 
problematic.  These  considerations,  which  established  with  a 
very  closed  participation  of  physicians,  have  permitted  to 
pose  an  adapted  protocol  of  example  bases  establishment. 
From  this  point  of  view,  the  idea  to  exploit  the  learning  base 
as  well  as  the  possibility  in  modeling  its  imperfection  has 
been  discussed.  We  have  briefly  proposed  the  integration  of 
this  kind  of  imperfection  with  a  classical  Bayes  supervised 
classification  approach.  We  can  conclude  that  the  idea  to 
combine  the  management  of  both  the  uncertainty  and  the 
information  ambiguity  is  a  very  interesting  challenge  for  an 
academic  as  well  as  an  applicative  point  of  view  in  the  near 
future.  The  application  of  thrombosis  analysis  shows  that  it  is 
necessary  to  consider  the  probabilistic  and  fuzzy  logic 
approaches  not  just  as  concurrent  methods  but  like  two 
complementary  way  to  process  the  information.  Further 
works  will  clarify  decision-making  and  compare  the  classical 
classification  methods  with  this  proposed  method  in  the  case 
where  the  learning  base  is  affected  by  ambiguity. 
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